Tactile apparatus link

ABSTRACT

An apparatus comprising: an input module configured to determine an input characteristic; a signal generator configured to generate a signal dependent on the input characteristic; and an output module configured to provide the signal to one or more separate apparatus, wherein the signal is configured to generate a tactile output.

CROSS REFERENCE TO RELATED APPLICATION

This is a continuation patent application of U.S. patent applicationSer. No. 14/383,559 filed on Sep. 7, 2014, which is a national stageapplication of PCT Application No. PCT/IB2012/051243 filed Mar. 15,2012, which are both hereby incorporated by reference in theirentireties.

FIELD

The present invention relates to providing tactile functionality. Theinvention further relates to, but is not limited to, display apparatusproviding tactile and speaker functionality for use in mobile devices.

BACKGROUND

Many portable devices, for example mobile telephones, are equipped witha display such as a glass or plastic display window for providinginformation to the user. Furthermore such display windows are nowcommonly used as touch sensitive inputs. The use of a touch sensitiveinput with the display has the advantage over a mechanical keypad inthat the display may be configured to show a range of different inputsdepending on the operating mode of the device. For example, in a firstmode of operation the display may be enabled to enter a phone number bydisplaying a simple numeric keypad arrangement and in a second mode thedisplay may be enabled for text input by displaying an alphanumericdisplay configuration such as a simulated Qwerty keyboard displayarrangement.

Furthermore such devices typically also use electro-acoustic transducersto produce audio for earpiece and speaker operations as well as foralert tones. The moving coil dynamic speaker configuration used istypically relatively large in relation to the volume within the deviceand require specific signal processing considerations in order that theacoustic frequency response is acceptable. Furthermore moving coiltransducers can attract contaminants such as small iron particles fromwithin the internal volume of the device and also through ports providedto enable acoustic wave transmission from the speaker to the externalenvironment. These contaminants can cause distortion and faults withinthe speakers significantly reducing the lifetime of the device.

STATEMENT

According to an aspect, there is provided a method for a communicationssystem comprising: determining an input characteristic; generating asignal dependent on the input characteristic; and providing the signalto one or more separate apparatus, wherein the signal is configured togenerate a tactile output in a suitable apparatus.

Determining an input characteristic may comprise: determining a touchinput; determining a characteristic of the touch input; and generating asignal dependent on the characteristic, wherein the signal is configuredto generate a tactile output.

Determining a characteristic of the touch input may comprise:determining a force/pressure of the touch input; determining adisplacement of the touch input in a first direction relative to an edgeof the touch input apparatus; determining a displacement of the touchinput in a second direction substantially orthogonal to the firstdirection; determining a speed of the touch input; determining aco-ordinate of the touch input; determining a number of points ofcontact of the touch input; and determining a gesture from the touchinput.

Determining a gesture from the touch input may comprise determining atleast one of: determining a swipe gesture; determining a pinch zoomgesture; determining a shape gesture; and determining a circular/arcgesture.

Generating the signal dependent on the input characteristic may compriseat least one of: determining a signal waveform dependent on the inputcharacteristic; determining a signal frequency dependent on the inputcharacteristic; determining a signal amplitude dependent on the inputcharacteristic; determining a modulation of a defined signal dependenton the input characteristic; and determining a signal pulse widthdependent on the input characteristic.

The method may further comprise: determining at least one further inputfrom a separate apparatus; determining a further input characteristic;and generating the signal dependent on the further input characteristic.

The method may further comprise determining a difference between theinput characteristic and the further input characteristic, whereingenerating the signal dependent on the further input characteristic maycomprise determining the signal dependent on the difference between theinput characteristic and the further input characteristic.

The method may further comprise: generating an audio signal; and mixingthe signal and the audio signal to form a combined signal.

The method may further comprise at least one of: storing the signal; andtransmitting the signal.

Transmitting the signal may comprise at least one of: transmitting thesignal as a component of a mixed signal, with at least one audio signal;transmitting the signal as an email; transmitting the signal as a MMSmessage; transmitting the signal as metadata accompanying an audiosignal; and transmitting the signal as a first channel signalaccompanying a second channel audio signal.

Determining an input characteristic may comprise at least one of:determining a status of the vibra component; determining a vibracomponent parameter; determining a proximity detector parameter;determining an ambient light sensor parameter; determining amagnetometer parameter; determining an accelerometer parameter;determining a GPS parameter; determining a status of the receiver;determining a status of a transmitter; determining a radio frequencyreceiver parameter; and determining a radio frequency transmitterparameter.

Generating a signal dependent on the input characteristic may compriseselecting one from a list of defined signals.

Generating a signal dependent on the input characteristic may furthercomprise embedding within the signal an indicator that the signal isconfigured to generate a tactile output in a suitable apparatus.

The indicator may be an audio watermark.

Providing the signal to one or more separate apparatus may comprise atleast one of: providing the signal via a telephony coupling; providingthe signal via a voice over Internet protocol network; providing thesignal via a server; providing the signal via a network; providing thesignal via a multimedia message service message; and providing thesignal via an email.

According to a second aspect there is provided a method comprising:receiving a signal dependent on an input characteristic from a separateapparatus; and generating a tactile output dependent on the signal.

Receiving the signal may comprise: receiving the signal from a memory;and receiving the signal from a further apparatus.

Generating the tactile output dependent on the signal may compriseoutputting the combined signal to an audio display module, wherein theaudio display module may be configured to transduce the signal componentto generate the tactile output.

The signal may be a component of a combined signal mixed with an audiosignal and the method may further comprise the audio display moduleconfigured to transduce the audio signal to generate an audio output.

The signal may comprise at least one of: an indicator for a vibrasignal; a vibra signal frequency; a vibra signal amplitude; a vibrasignal waveform definition; a vibra signal waveform definitionindicator; and at least one sine wave signal.

The method may further comprise generating a visual output dependent onthe signal.

Receiving the signal dependent on an input characteristic from aseparate apparatus may comprise at least one of: receiving the signalvia a telephony coupling; receiving the signal via a voice over Internetprotocol network; receiving the signal via a server; receiving thesignal via a network; receiving the signal via a multimedia messageservice message; and receiving the signal via an email.

The tactile output may comprise at least one of: an audio signal; anhaptic feedback; a vibra signal; an audio/haptic signal; a visualsignal; an audio/visual data signal; a haptic/visual data signal; and anaudio/visual/haptic signal.

According to a third aspect there is provided apparatus comprising atleast one processor and at least one memory including computer code forone or more programs, the at least one memory and the computer codeconfigured to with the at least one processor cause the apparatus to atleast perform: determining an input characteristic; generating a signaldependent on the input characteristic; and providing the signal to oneor more separate apparatus, wherein the signal is configured to generatea tactile output.

Determining an input characteristic may cause the apparatus to perform:determining a touch input; determining a characteristic of the touchinput; and generating a signal dependent on the characteristic, whereinthe signal is configured to generate a tactile output.

The determining a characteristic of the touch input causes the apparatusto perform: determining a force/pressure of the touch input; determininga displacement of the touch input in a first direction relative to anedge of the touch input apparatus; determining a displacement of thetouch input in a second direction substantially orthogonal to the firstdirection; determining a speed of the touch input; determining aco-ordinate of the touch input; determining a number of points ofcontact of the touch input; and determining a gesture from the touchinput.

Determining a gesture from the touch input may cause the apparatus toperform determining at least one of: determining a swipe gesture;determining a pinch zoom gesture; determining a shape gesture; anddetermining a circular/arc gesture.

Generating the signal dependent on the input characteristic may causethe apparatus to perform at least one of: determining a signal waveformdependent on the input characteristic; determining a signal frequencydependent on the input characteristic; determining a signal amplitudedependent on the input characteristic; determining a modulation of adefined signal dependent on the input characteristic; and determining asignal pulse width dependent on the input characteristic.

The apparatus may further perform: determining at least one furtherinput from a separate apparatus; determining a further inputcharacteristic; and generating the signal dependent on the further inputcharacteristic.

The apparatus may further perform determining a difference between theinput characteristic and the further input characteristic, whereingenerating the signal dependent on the further input characteristiccauses the apparatus to perform determining the signal dependent on thedifference between the input characteristic and the further inputcharacteristic.

The apparatus may be further caused to perform: generating an audiosignal; and mixing the signal and the audio signal to form a combinedsignal.

The apparatus may further perform at least one of: storing the signal;and transmitting the signal.

Transmitting the signal may cause the apparatus to perform at least oneof: transmitting the signal as a component of a mixed signal, with atleast one audio signal; transmitting the signal as an email;transmitting the signal as a MMS message; transmitting the signal asmetadata accompanying an audio signal; and transmitting the signal as afirst channel signal accompanying a second channel audio signal.

Determining an input characteristic may cause the apparatus to performat least one of: determining a status of the vibra component;determining a vibra component parameter; determining a proximitydetector parameter; determining an ambient light sensor parameter;determining a magnetometer parameter; determining an accelerometerparameter; determining a GPS parameter; determining a status of thereceiver; determining a status of a transmitter; determining a radiofrequency receiver parameter; and determining a radio frequencytransmitter parameter.

Generating a signal dependent on the input characteristic may cause theapparatus to perform selecting one from a list of defined signals.

Generating a signal dependent on the input characteristic may cause theapparatus to perform embedding within the signal an indicator that thesignal is configured to generate a tactile output in a suitableapparatus.

The indicator may be an audio watermark.

Providing the signal to one or more separate apparatus may cause theapparatus to perform at least one of: providing the signal via atelephony coupling; providing the signal via a voice over internetprotocol network; providing the signal via a server; providing thesignal via a network; providing the signal via a multimedia messageservice message; and providing the signal via an email.

According to fourth aspect there is provided an apparatus comprising atleast one processor and at least one memory including computer code forone or more programs, the at least one memory and the computer codeconfigured to with the at least one processor cause the apparatus to atleast perform: receiving a signal dependent on an input characteristicfrom a separate apparatus; and generating a tactile output dependent onthe signal.

Receiving the signal may cause the apparatus to perform: receiving thesignal from memory; and receiving the signal from a further apparatus.

Generating the tactile output dependent on the signal may cause theapparatus to perform outputting the combined signal to an audio displaymodule, wherein the audio display module may be configured to transducethe signal component to generate the tactile output.

The signal may be a component of a combined signal mixed with an audiosignal and the apparatus may be further caused to perform controllingthe audio display module to generate an audio output.

The signal may comprise at least one of: an indicator for a vibrasignal; a vibra signal frequency; a vibra signal amplitude; a vibrasignal waveform definition; vibra signal waveform definition indicator;and at least one sine wave signal.

The apparatus may be caused to perform generating a visual outputdependent on the signal.

Receiving the signal dependent on an input characteristic from aseparate apparatus may cause the apparatus to perform at least one of:receiving the signal via a telephony coupling; receiving the signal viaa voice over internet protocol network; receiving the signal via aserver; receiving the signal via a network; receiving the signal via amultimedia message service message; and receiving the signal via anemail.

The tactile output may comprise at least one of: an audio signal; anhaptic feedback; a vibra signal; an audio/haptic signal; a visualsignal; an audio/visual data signal; a haptic/visual data signal; and anaudio/visual/haptic signal.

According to fifth aspect there is provided an apparatus comprising:means for determining an input characteristic; means for generating asignal dependent on the input characteristic; and means for providingthe signal to one or more separate apparatus, wherein the signal isconfigured to generate a tactile output.

The means for determining an input characteristic may comprise: meansfor determining a touch input; means for determining a characteristic ofthe touch input; and means for generating a signal dependent on thecharacteristic, wherein the signal is configured to generate a tactileoutput.

The means for determining a characteristic of the touch input maycomprise: means for determining a force/pressure of the touch input;means for determining a displacement of the touch input in a firstdirection relative to an edge of the touch input apparatus; means fordetermining a displacement of the touch input in a second directionsubstantially orthogonal to the first direction; means for determining aspeed of the touch input; means for determining a co-ordinate of thetouch input; means for determining a number of points of contact of thetouch input; and means for determining a gesture from the touch input.

The means for determining a gesture from the touch input may comprise atleast one of: means for determining a swipe gesture; means fordetermining a pinch zoom gesture; means for determining a shape gesture;and means for determining a circular/arc gesture.

The means for generating the signal dependent on the inputcharacteristic may comprise at least one of: means for determining asignal waveform dependent on the input characteristic; means fordetermining a signal frequency dependent on the input characteristic;means for determining a signal amplitude dependent on the inputcharacteristic; means for determining a modulation of a defined signaldependent on the input characteristic; and means for determining asignal pulse width dependent on the input characteristic.

The apparatus may further comprise: means for determining at least onefurther input from a separate apparatus; means for determining a furtherinput characteristic; and means for generating the signal dependent onthe further input characteristic.

The apparatus may comprise means for determining a difference betweenthe input characteristic and the further input characteristic, whereinthe means for generating the signal dependent on the further inputcharacteristic comprise means for determining the signal dependent onthe difference between the input characteristic and the further inputcharacteristic.

The apparatus may further comprise: means for generating an audiosignal; and means for mixing the signal and the audio signal to form acombined signal.

The apparatus may comprise at least one of: means for storing thesignal; and means for transmitting the signal.

The means for transmitting the signal may comprise at least one of:means for transmitting the signal as a component of a mixed signal, withat least one audio signal; means for transmitting the signal as anemail; means for transmitting the signal as a MMS message; means fortransmitting the signal as metadata accompanying an audio signal; andmeans for transmitting the signal as a first channel signal accompanyinga second channel audio signal.

The means for determining an input characteristic may comprise at leastone of: means for determining a status of the vibra component; means fordetermining a vibra component parameter; means for determining aproximity detector parameter; means for determining an ambient lightsensor parameter; means for determining a magnetometer parameter; meansfor determining an accelerometer parameter; means for determining a GPSparameter; means for determining a status of the receiver; means fordetermining a status of a transmitter; means for determining a radiofrequency receiver parameter; and means for determining a radiofrequency transmitter parameter.

The means for generating a signal dependent on the input characteristicmay comprise means for selecting one from a list of defined signals.

The means for generating a signal dependent on the input characteristicmay comprise means for embedding within the signal an indicator that thesignal is configured to generate a tactile output in a suitableapparatus.

The indicator may be an audio watermark.

The means for providing the signal to one or more separate apparatus maycomprise at least one of: means for providing the signal via a telephonycoupling; means for providing the signal via a voice over Internetprotocol network; means for providing the signal via a server; means forproviding the signal via a network; means for providing the signal via amultimedia message service message; and means for providing the signalvia an email.

According to a sixth aspect there is provided an apparatus comprising:means for receiving a signal dependent on an input characteristic from aseparate apparatus; and means for generating a tactile output dependenton the signal.

The means for receiving the signal may comprise at least one of: meansfor receiving the signal from memory; and means for receiving the signalfrom a further apparatus.

The means for generating the tactile output dependent on the signal maycomprise means for outputting the combined signal to an audio displaymodule, wherein the audio display module is configured to transduce thesignal component to generate the tactile output.

The signal may be a component of a combined signal mixed with an audiosignal and the apparatus may comprise means for controlling the audiodisplay module to generate an audio output.

The signal may comprise at least one of: an indicator for a vibrasignal; a vibra signal frequency; a vibra signal amplitude; a vibrasignal waveform definition; vibra signal waveform definition indicator;and at least one sine wave signal.

The apparatus may comprise means for generating a visual outputdependent on the signal.

The means for receiving the signal dependent on an input characteristicfrom a separate apparatus may comprise at least one of: means forreceiving the signal via a telephony coupling; means for receiving thesignal via a voice over internet protocol network; means for receivingthe signal via a server; means for receiving the signal via a network;means for receiving the signal via a multimedia message service message;and means for receiving the signal via an email.

The tactile output may comprise at least one of: an audio signal; anhaptic feedback; a vibra signal; an audio/haptic signal; a visualsignal; an audio/visual data signal; a haptic/visual data signal; and anaudio/visual/haptic signal.

According to a seventh aspect there is provided an apparatus comprising:an input module configured to determine an input characteristic; asignal generator configured to generate a signal dependent on the inputcharacteristic; and an output module configured to provide the signal toone or more separate apparatus, wherein the signal is configured togenerate a tactile output.

The input module may comprise: a touch input module configured todetermine a touch input; a touch characteristic determiner configured todetermine a characteristic of the touch input; and the signal generatoris configured to generate a signal dependent on the characteristic,wherein the signal is configured to generate a tactile output.

The touch characteristic determiner may be configured to determine atleast one of: a force/pressure of the touch input; a displacement of thetouch input in a first direction relative to an edge of the touch inputapparatus; a displacement of the touch input in a second directionsubstantially orthogonal to the first direction; a speed of the touchinput; a co-ordinate of the touch input; a number of points of contactof the touch input; and a gesture from the touch input.

The gesture from the touch input may comprise at least one of: a swipegesture; a pinch zoom gesture; a shape gesture; and a circular/arcgesture.

The signal generator may be configured to generate at least one of: asignal waveform dependent on the input characteristic; a signalfrequency dependent on the input characteristic; a signal amplitudedependent on the input characteristic; a modulation of a defined signaldependent on the input characteristic; and a signal pulse widthdependent on the input characteristic.

The apparatus may further comprise: a further input configured todetermine at least one further input from a separate apparatus; afurther input characteristic determiner configured to determine afurther input characteristic; wherein the signal generator is configuredto generate the signal dependent on the further input characteristic.

The apparatus may comprise an input characteristic difference determinerconfigured to determine a difference between the input characteristicand the further input characteristic, wherein the signal generator isconfigured to generate the signal dependent on the difference betweenthe input characteristic and the further input characteristic.

The apparatus may further comprise: an audio signal source configured togenerate an audio signal; and a mixer configured to mix the signal andthe audio signal to form a combined signal.

The apparatus may comprise at least one of: a memory configured to storethe signal; and a transmitter configured to transmit the signal.

The transmitter may be configured to transmit the signal as at least oneof: a component of a mixed signal, with at least one audio signal; anemail; a MMS message; metadata accompanying an audio signal; and a firstchannel signal accompanying a second channel audio signal.

The input module may be configured to receive at least one of: a statusof the vibra component; a vibra component parameter; a proximitydetector parameter; an ambient light sensor parameter; a magnetometerparameter; an accelerometer parameter; a GPS parameter; a status of thereceiver; a status of a transmitter; a radio frequency receiverparameter; and a radio frequency transmitter parameter.

The signal generator may be configured to select one from a list ofdefined signals.

The signal generator may be configured to embed within the signal anindicator that the signal is configured to generate a tactile output ina suitable apparatus.

The indicator may be an audio watermark.

The output module may be configured to at least one of: provide thesignal via a telephony coupling; provide the signal via a voice overinternet protocol network; provide the signal via a server; provide thesignal via a network; provide the signal via a multimedia messageservice message; and provide the signal via an email.

According to an eighth aspect there is provided an apparatus comprising:a decoder configured to generate a signal dependent on a received inputcharacteristic from a separate apparatus; and an audio driver configuredto generate a tactile output dependent on the signal.

The apparatus may comprise at least one of: a memory configured to storethe signal; and a receiver configured to receive the signal from afurther apparatus.

The decoder may be configured to output the combined signal to an audiodisplay module, wherein the audio display module may be configured totransduce the signal component to generate the tactile output.

The signal may be a component of a combined signal mixed with an audiosignal and the apparatus comprises an audio driver configured to controlthe audio display module to generate an audio output.

The signal may comprise at least one of: an indicator for a vibrasignal; a vibra signal frequency; a vibra signal amplitude; a vibrasignal waveform definition; vibra signal waveform definition indicator;and at least one sine wave signal.

The apparatus may comprise a display for generating a visual outputdependent on the signal.

The decoder may be configured to: receive the signal via a telephonycoupling; receive the signal via a voice over Internet protocol network;receive the signal via a server; receive the signal via a network;receive the signal via a multimedia message service message; and receivethe signal via an email.

The tactile output may comprise at least one of: an audio signal; anhaptic feedback; a vibra signal; an audio/haptic signal; a visualsignal; an audio/visual data signal; a haptic/visual data signal; and anaudio/visual/haptic signal.

A computer program product may be stored on a medium for causing anapparatus to perform the method as described herein.

An electronic device may comprise apparatus as described herein.

A chipset may comprise apparatus as described herein.

SUMMARY OF FIGURES

For better understanding of the present invention, reference will now bemade by way of example to the accompanying drawings in which:

FIG. 1 shows schematically an apparatus suitable for employing someembodiments;

FIG. 2 shows schematically a tactile user input apparatus according tosome embodiments;

FIG. 3 shows a flow-diagram of the operation of the tactile user inputapparatus as shown in FIG. 2 according to some embodiments;

FIG. 4 shows schematically a tactile user output apparatus according tosome embodiments;

FIG. 5 shows a flow-diagram of the operation of the tactile user outputapparatus as shown in FIG. 4 according to some embodiments;

FIG. 6 shows schematically a touch-audio signal generator as shown inFIG. 2 according to some touch-frequency modulation embodiments;

FIG. 7 shows a flow-diagram of the operation of the touch-audio signalgenerator as shown in FIG. 6 according to some embodiments;

FIG. 8 shows schematically a touch-audio signal generator as shown inFIG. 2 according to some touch-amplitude modulation embodiments;

FIG. 9 shows a flow-diagram of the operation of the touch-audio signalgenerator as shown in FIG. 8 according to some embodiments;

FIG. 10 shows schematically a touch-audio signal generator as shown inFIG. 2 according to some touch-pressure modulation embodiments;

FIG. 11 shows a flow-diagram of the operation of the touch-audio signalgenerator as shown in FIG. 10 according to some embodiments;

FIG. 12 shows schematically a touch-audio signal generator as shown inFIG. 2 according to some multichannel touch modulation embodiments; and

FIG. 13 shows a flow-diagram of the operation of the touch-audio signalgenerator as shown in FIG. 12 according to some embodiments.

DESCRIPTION OF EXAMPLE EMBODIMENTS

The application describes apparatus and methods capable of generating,encoding, storing, transmitting and outputting tactile and acousticoutputs from a touch screen device.

With respect to FIG. 1 a schematic block diagram of an exampleelectronic device 10 or apparatus on which embodiments of theapplication can be implemented. The apparatus 10 is such embodimentsconfigured to provide improved tactile and acoustic wave generation.

The apparatus 10 is in some embodiments a mobile terminal, mobile phoneor user equipment for operation in a wireless communication system. Inother embodiments, the apparatus is any suitable electronic deviceconfigured to provide an image display, such as for example a digitalcamera, a portable audio player (mp3 player), a portable video player(mp4 player). In other embodiments the apparatus can be any suitableelectronic device with touch interface (which may or may not displayinformation) such as a touch-screen or touch-pad configured to providefeedback when the touch-screen or touch-pad is touched. For example insome embodiments the touch-pad can be a touch-sensitive keypad which canin some embodiments have no markings on it and in other embodiments havephysical markings or designations on the front window. An example ofsuch a touch sensor can be a touch sensitive user interface to replacekeypads in automatic teller machines (ATM) that does not require ascreen mounted underneath the front window projecting a display. Theuser can in such embodiments be notified of where to touch by a physicalidentifier—such as a raised profile, or a printed layer which can beilluminated by a light guide.

The apparatus 10 comprises a touch input module or user interface 11,which is linked to a processor 15. The processor 15 is further linked toa display 12. The processor 15 is further linked to a transceiver(TX/RX) 13 and to a memory 16.

In some embodiments, the touch input module 11 and/or the display 12 areseparate or separable from the electronic device and the processorreceives signals from the touch input module 11 and/or transmits andsignals to the display 12 via the transceiver 13 or another suitableinterface. Furthermore in some embodiments the touch input module 11 anddisplay 12 are parts of the same component. In such embodiments thetouch interface module 11 and display 12 can be referred to as thedisplay part or touch display part.

The processor 15 can in some embodiments be configured to executevarious program codes. The implemented program codes, in someembodiments can comprise such routines as touch capture digitalprocessing or configuration code where the touch input module inputs aredetected and processed, pseudo-audio signal generation and processingwhere electrical signals are generated which when passed to a transducercan generate tactile or haptic feedback to the user of the apparatus, oractuator processing configured to generate an actuator signal fordriving an actuator. The implemented program codes can in someembodiments be stored for example in the memory 16 and specificallywithin a program code section 17 of the memory 16 for retrieval by theprocessor 15 whenever needed. The memory 15 in some embodiments canfurther provide a section 18 for storing data, for example data that hasbeen processed in accordance with the application, for examplepseudo-audio signal data.

The touch input module 11 can in some embodiments implement any suitabletouch screen interface technology. For example in some embodiments thetouch screen interface can comprise a capacitive sensor configured to besensitive to the presence of a finger above or on the touch screeninterface. The capacitive sensor can comprise an insulator (for exampleglass or plastic), coated with a transparent conductor (for exampleindium tin oxide—ITO). As the human body is also a conductor, touchingthe surface of the screen results in a distortion of the localelectrostatic field, measurable as a change in capacitance. Any suitabletechnology may be used to determine the location of the touch. Thelocation can be passed to the processor which may calculate how theuser's touch relates to the device. The insulator protects theconductive layer from dirt, dust or residue from the finger.

In some other embodiments the touch input module can be a resistivesensor comprising of several layers of which two are thin, metallic,electrically conductive layers separated by a narrow gap. When anobject, such as a finger, presses down on a point on the panel's outersurface the two metallic layers become connected at that point: thepanel then behaves as a pair of voltage dividers with connected outputs.This physical change therefore causes a change in the electrical currentwhich is registered as a touch event and sent to the processor forprocessing.

In some other embodiments the touch input module can further determine atouch using technologies such as visual detection for example a cameraeither located below the surface or over the surface detecting theposition of the finger or touching object, projected capacitancedetection, infra-red detection, surface acoustic wave detection,dispersive signal technology, and acoustic pulse recognition. In someembodiments it would be understood that ‘touch’ can be defined by bothphysical contact and ‘hover touch’ where there is no physical contactwith the sensor but the object located in close proximity with thesensor has an effect on the sensor.

The apparatus 10 can in some embodiments be capable of implementing theprocessing techniques at least partially in hardware, in other words theprocessing carried out by the processor 15 may be implemented at leastpartially in hardware without the need of software or firmware tooperate the hardware.

The transceiver 13 in some embodiments enables communication with otherelectronic devices, for example in some embodiments via a wirelesscommunication network.

The display 12 may comprise any suitable display technology. For examplethe display element can be located below the touch input module andproject an image through the touch input module to be viewed by theuser. The display 12 can employ any suitable display technology such asliquid crystal display (LCD), light emitting diodes (LED), organic lightemitting diodes (OLED), plasma display cells, Field emission display(FED), surface-conduction electron-emitter displays (SED), andElectophoretic displays (also known as electronic paper, e-paper orelectronic ink displays). In some embodiments the display 12 employs oneof the display technologies projected using a light guide to the displaywindow. As described herein the display 12 in some embodiments can beimplemented as a physical fixed display. For example the display can bea physical decal or transfer on the front window. In some otherembodiments the display can be located on a physically different levelfrom the rest of the surface, such a raised or recessed marking on thefront window. In some other embodiments the display can be a printedlayer illuminated by a light guide under the front window.

In some embodiments, the apparatus comprises an orientation sensor. Theorientation sensor can be any suitable orientation sensor. Theorientation sensor can in some embodiments be part of a position sensorconfigured to estimate the position of the apparatus. The positionsensor can in some embodiments be a satellite positioning sensor such asGPS (Global Positioning System), GLONASS or Galileo receiver.

In some embodiments, the positioning sensor can be a cellular ID systemor assisted GPS system.

In some embodiments, the orientation sensor can be any suitableorientation sensor. For example, in some embodiments the orientationsensor can be an electronic compass, an accelerometer, a gyroscope or bedetermined by the motion of the apparatus using the positioning estimate(in other words, dead reckoning).

With respect to FIG. 2 an example tactile user input apparatus accordingto some embodiments is shown. With respect to FIG. 3 a flow diagramshowing the operation of the example tactile user input apparatus isshown. In some embodiments the tactile user input apparatus comprisesthe touch input module 11 configured to provide a suitable electricalsignal representing the touch input. The touch input module isconfigured to pass the touch input signal to the touch audio signalgenerator 101.

Furthermore in some embodiments the tactile user input apparatuscomprises an audio signal source 103. The audio signal source can be anysuitable signal source. For example the audio signal can be a microphoneinput (recording a concert or a telephone conversation). The audiosignal source 103 can be configured to output a generated electricalsignal representing the audio signal to the audio mixer 105.

In some embodiments the tactile user input apparatus comprises a touchaudio signal generator 101. The touch audio signal generator 101 isconfigured to receive the touch input signal from the touch input module11.

The operation of receiving the touch input at the touch audio signalgenerator 101 is shown in FIG. 3 by step 201.

Furthermore in some embodiments the tactile user input apparatus isconfigured to generate a suitable electrical signal representing a‘pseudo-audio’ signal which when passed to a tactile user outputapparatus, such as an output apparatus featuring an audio display asdescribed herein is able to reproduce a tactile output representing thetouch input.

The operation of generating the pseudo-audio signal dependent on thetouch input is shown in FIG. 3 by step 203.

The touch audio signal generator 101 can in some embodiments beconfigured to output the pseudo-audio signal to an audio mixer 105.

In some embodiments the tactile user input apparatus comprises an audiomixer 105. The audio mixer 105 is configured to receive the audiosignals from the audio signal source and the pseudo-audio signals fromthe touch audio signal generator 101 and mix these signals to form acombined audio signal. The combined audio signal can then be passed toan encoder 107. In some embodiments the audio mixer 105 can beconfigured to ‘mix’ or pass the pseudo-audio signals from the touchaudio signal generator 101 where there is no active audio input. Forexample in some embodiments the user of the apparatus can be configuredto generate, encode and transmit a tactile signal without any audiosignal transmission as a purely pseudo-audio signal. In some embodimentsthe audio mixer 105 can be configured to receive more than one audiosignal and/or more than one pseudo-audio signal and mix them into onesuitable audio output signal. In some embodiments, for example, the morethan one audio signal can be a mixing of two different audio sources(for example a microphone input with a stored audio source). In someembodiments the more than one pseudo-audio signal can also be receivedfrom more than one tactile source. For example in some embodiments theapparatus can comprise more than one screen, each of which is coupled tothe touch audio signal generator 101 configured to generate two channelsof ‘pseudo-audio’ signals, each channel associated with a displaytactile input. Similarly the microphone or audio source can be a morethan one channel, such as a stereo or array microphone arrangementconfigured to generate a multichannel audio signal. The multichannelaudio signals can then in such embodiments be mixed with themultichannel tactile pseudo-audio signals to generate multichannelcombined signals to be encoded, transmitted, received and output in amanner similar to that described herein.

In some embodiments the audio mixer 105 is configured to pass thereceived audio and pseudo-audio signals to be transmitted and/or storedas separate channels. For example in some embodiments where the signalsare transmitted over a VoIP network, metadata can be sent alongside thephone calf audio signal. The metadata can for example be associated withthe tactile or pseudo-audio signals. In some embodiments the tactileinformation may be transmitted over a separate channel than the audiosignal. For example in some embodiments the tactile information may bepassed to other apparatus via a MMS, email or other message type. Insome embodiments therefore the generation and processing of the touch ortactile pseudo-audio signals is performed using a dedicated pseudo-audiosignal pathway.

The operation of mixing the pseudo-audio signal with the audio signalsource data to create a combined audio signal is shown in FIG. 3 by step205.

In some embodiments the tactile user input apparatus comprises anencoder 107. The encoder can be any suitable encoder, for example asuitable wireless communications or data storage audio signal encoder.

The encoder can be configured in some embodiments the output the encodedsignal to a transmitter. In some embodiments the output of the encoder107 can be stored in memory for later transmission or reconstruction onthe same device at a later time. It would be understood that in someembodiments no encoding is performed and the output is a plain pulsecoded modulation (PCM) or similar audio signal. In such embodiments atleast the pseudo-audio signal is passed to the transmitter fortransmission/memory for storage.

The operation of encoding the combined signal is shown in FIG. 3 by step207. In some embodiments the tactile user input apparatus comprises atransmitter 109. The transmitter can be any suitable transmitter meansconfigured to output the encoded audio signal to a further apparatus.For example in some embodiments the transmitter can be configured tocommunicate over a circuit switched (CS) network such as for example acellular network and/or a packet switched (PS) network such as forexample a Wi-Fi (IEEE 802.11) network.

The operation of transmitting the audio signal is shown in FIG. 3 bystep 209.

With respect to FIG. 4 an example of a tactile user output apparatusaccording to some embodiments is shown. Furthermore with respect to FIG.5 the operation of the tactile user output apparatus as shown in FIG. 4is shown.

In some embodiments the tactile user output apparatus comprises areceiver 301. The receiver 301 is configured to receive the transmittedencoded combined audio signal. The receiver 301 can be any suitablereceiver such as for example a wireless communications receiver orsuitable receiver means.

In some embodiments the output of the receiver 301 can be passed to thedecoder 303.

The operation of receiving the audio signal is shown in FIG. 5 by step401.

The tactile user output apparatus in some embodiments comprises adecoder 303. The decoder 303 is configured to receive the receivedencoded combined audio signal from the receiver 301 and decode the audiosignal using a suitable decoding process (being the opposite to theencoding process used in the encoder 107 of the tactile user inputapparatus as shown in FIG. 2).

The decoder 303 can be any suitable decoder or decoding means.

The operation of decoding the audio signal is shown in FIG. 5 by step403.

The decoder in some embodiments can pass the decoded combined audiosignal to an audio driver 305.

In some embodiments the tactile user output apparatus comprises an audiodriver 305 configured to receive the decoded combined audio signal. Theaudio driver 305 is configured to process the combined audio signal insuch a way that it drives the audio transducers coupled to the display.

The operation of converting the audio signal into a drive signal for theaudio display is shown in FIG. 5 by step 405.

In some embodiments the tactile user output apparatus comprises theaudio display 12. The audio display 12, can in some embodiments be thetouch display as described herein configured to receive the combinedaudio signal drive signal and based on this signal to generate not onlyan acoustic waves (typically with a frequency greater than 300 Hz) butalso is configured to generate tactile waves using the audio display(typically using audio signals below 300 Hz).

The operation of generating the acoustic waves by the audio display andthe tactile waves by the audio display is shown in FIG. 5 by step 407.

The coupling or communications medium or network between the transmitterand receiver can be any suitable medium. As described herein the networkcould in some embodiments be any suitable circuit switched, packetswitched or hybrid network. For example in some embodiments thetransmitter and receiver are cellular or mobile network transmitter andreceivers communicating over a circuit switched network. Similarly thetransmitter and receiver are packet switched wireless communicationsnetwork elements. In some embodiments the communication can be overBluetooth or other suitable short distance wireless link.

Similarly in some embodiments the transmitter and receiver are wirednetwork components, for example a circuit switched communications systemsuch as the POTS circuit switched network, a packet switched networksuch as a voice over Internet protocol (VoIP) communications or anysuitable combination or hybrid communications system.

In some embodiments the transmitter and receiver elements can bereplaced by memory storage means. For example the encoded combined audiosignal is stored on a memory which can in some embodiments bereplaceable or fixed to the apparatus, and at a later time the encodedcombined audio signal is played to produce an audio and tactile event.Thus in some embodiments while recording an audio event with theapparatus the user can tap the screen to create a physical reminderwhich can be output as a tactile output when the audio event isreplayed.

In some embodiments the apparatus can be used during two partytelephony, when the one party uses the touch screen the touch event iscoded to the audio signal and mixed to the uplink signal of the phonecall. The second party with the receiver, having a tactile audio displaydevice, can feel the touch feedback on their device by holding theirhand on the display. In such a way the transmitter can send a physicalevent to the receiver of the call.

In a first example a circuit switched phone call is established betweentwo communications apparatus, the tactile user output apparatus and thetactile user input apparatus. The user of the tactile user inputapparatus can touch the touch screen, the touch audio signal generator101 generate a fixed frequency and fixed amplitude audio signal which ispassed to the audio mixer 105 to be mixed with the uplink audio signalsource signal. This is encoded and transmitted to the tactile useroutput apparatus which is then decoded and passed to the audio displaywhich when held is able to transfer a touch event signal as the hapticfeedback generated by the audio display.

In some embodiments the frequency of the touch event generates a 300 Hzaudio signal or pseudo-audio signal and a fixed amplitude for example a16 bit full scale sine wave audio signal to be mixed to the uplinksignal.

It would be instead that in some embodiments a packet switched or voiceover Internet protocol (VoIP) call can transmit the fixed frequency andfixed amplitude audio signal mixed to the uplink signal.

Although in the embodiments described above the communication occursbetween two tactile audio display apparatus it would be understood thatmore than two tactile audio display apparatus can be used to implement amultiparty teleconference communication. In such embodiments a firstcommunications apparatus can be configured to communicate to more thanone further communications apparatus, each of the receiving apparatusbeing configured to regenerate the encoded combined audio signal whichwhen output by the audio display on each receiving apparatus can beconfigured to provide both acoustic and tactile output. It would beunderstood that although the embodiments described herein discuss atransmission of speech/audio with tactile audio display embodiments thatin some embodiments video calling and therefore audio video and tactilecommunication can be provided.

Furthermore in some embodiments the tactile user input apparatus can beused to communicate with a service provider or receive information froma service provider in the form of a purely tactile signal on the audiodisplay. For example the service provider could be configured to provideaudio signals to power the tactile audio display of the communicationsapparatus and so providing tactile information or feedback with orwithout audio feedback. In such embodiments the operator of thecommunications apparatus can hold their hand on the display and feel thetouch event signal from the service. In some embodiments the user of thecommunications apparatus can then respond or request different types ofsignals using the DTMF tone dialing feature of the apparatus. Theservice in such embodiments detects the tones and performs the request,for example playing the requested signal.

In some embodiments the feedback may be requested by other suitablemeans other than DTMF. For example in some embodiments there could be aseparate application the user of the apparatus can use to requesttactile feedback, for example the application using some proprietarymeans.

With respect to FIG. 6 an example touch audio signal generator 101 isshown in further detail. The touch audio signal generator 101 asdescribed herein is configured to enable haptic feedback generated by auser of the communications apparatus to generate a pseudo-audio signaland to be output by a suitable audio display as a regenerated tactileoutput.

In some embodiments the touch audio signal generator 101 comprises atouch frequency modulator 505. The operation of the touch audio signalgenerator touch frequency modulator 505 is shown in FIG. 7.

In such embodiments the touch frequency modulator 505 is configured toreceive the touch signal from the touch input module 11 and generate asuitable pseudo-audio signal dependent on the touch location.

For example in some embodiments the touch frequency modulator 505 isconfigured to determine the touch location or multiple touch locationson the touch input module 11. In the following examples the touchlocation is determined with respect the location of the touch in the Yaxis of the apparatus. However as described herein the touch frequencymodulator 505 can in some embodiments be configured to modulate thepseudo-audio signal output dependent on X axis, touch pressure or force,number of touch points or any suitable combination of determinable inputparameters or characteristics from the touch input module. The followingexamples show touch pseudo-audio modulators configured to generate apseudo-audio signal dependent on a single touch input however it wouldbe understood that any of the following examples can be implemented formulti-touch inputs.

The operation of determining the touch location, for example the Y axisdisplacement is shown in FIG. 7 by step 601.

The touch frequency modulator 505 can then be configured to determine orlook up a suitable output pseudo-audio signal frequency dependent on thedetermined Y axis displacement of the touch point.

For example as shown in FIG. 6 the touch frequency modulator 505 has alinear relationship between the Y axis touch point displacement and theoutput frequency such that a first Y axis displacement 501 generates afirst frequency F₁ 511 and a second Y displacement touch 503 generate asecond frequency F₂ 513. In some embodiments of the first frequency F₁can be 250 Hz and the second frequency F₂ 290 Hz. In other words as thetouch event moves upwards on the device, (the Y axis touch pointdisplacement increases) the frequency of the touch audio pseudo-audiosignal increases.

The operation of determining a touch audio signal frequency dependent onthe location is shown in FIG. 7 by step 603.

Although a linear relationship is shown between the Y axis touch pointdisplacement and frequency any suitable relationship can be implementedin embodiments. For example the relationship could be non-linear,proportional or inversely proportional, monotonic or non-monotonic orany suitable mathematical relationship. In some embodiments a look uptable rather than a mathematical determination can be implemented todetermine the output with respect to the touch input characteristic.

With respect to FIG. 8 an example touch audio signal generator 101performing touch amplitude modulation is shown. Furthermore with respectto FIG. 9 the operation performing touch amplitude modulation in thetouch audio signal generator 101 is shown.

In some embodiments the touch audio signal generator 101 comprises atouch amplitude modulator 705. The touch amplitude modulator 705 isconfigured to modulate the amplitude of the generated pseudo-audiosignal to change the amplitude dependent on a characteristic ordetermined parameter of the touch input module signal. In the exampleshown in FIGS. 8 and 9 the amplitude of the pseudo-audio signal isdependent on the X axis touch point displacement. However it would beunderstood that in some other embodiments the amplitude modulation canbe dependent on the Y axis touch point displacement, pressure or forceof the touch input, number of touch points or any suitable combinationor selection of parameters.

The touch amplitude modulator 705 is in some embodiments configured todetermine the touch location with respect to the X axis of the display.

The operation of determining the touch location X displacement is shownin FIG. 9 by step 801.

The touch amplitude modulator 705 then can be configured to determine atouch audio pseudo-audio signal amplitude dependent on the X axis touchpoint displacement. In the example shown in FIG. 8 the relationshipbetween the X axis touch point displacement and the amplitude is alinear proportional relationship. The touch amplitude modulator 705 forexample is configured to output a first amplitude A₁ 711 for a first Xaxis displacement touch input 701 and a second amplitude A₂ 713 for asecond X axis displacement value 703. For example in the example shownin FIGS. 8 and 9 the first touch displacement point 701 can beconfigured to enable the touch amplitude modulator 705 to output a 16bit half scale sine wave at 300 Hz whereas the second touch location 703generates a full scale sine wave at 300 Hz.

However any suitable relationship can be implemented. For example therelationship could be non-linear, proportional or inverselyproportional, monotonic or non-monotonic or any suitable mathematicalrelationship. In some embodiments a look up table rather than amathematical determination can be implemented to determine the outputwith respect to the touch input characteristic.

With respect to FIG. 10 a touch audio signal generator comprising atouch force modulator is shown. Furthermore with respect to FIG. 11 thetouch force modulator operations are shown in further detail.

In some embodiments the touch audio signal generator can be configuredto detect the strength or force or pressure of the touch and modulatethe tactile output dependent on the force or pressure.

In some embodiments the touch audio signal generator 101 comprises aforce determiner 901. The force determiner 901 is configured todetermine the touch pressure or force applied to the touch input module11. The force determiner 901 is configured to output the determinedforce value to a touch force modulator 903.

The operation of determining the touch pressure or force is shown inFIG. 11 by step 1001.

The touch audio signal generator 101 can furthermore be configured tocomprise a touch force modulator 903. The touch force modulator 903 canbe configured to determine a touch audio signal dependent on thepressure or force applied to the touch input module 11 as evaluated bythe force determiner 901. In some embodiments the touch force modulator903 is configured to modulate the amplitude of the touch audiopseudo-audio signal. Thus a first pressure or force of 50% of the fullscale strength can be configured to generate by the touch forcemodulator a half scale sine wave such as a 16 bit half scale sine waveat 300 Hz. This audio signal would there be mixed to the uplink signalas described herein. Whereas a touch event pressed at the maximumstrength that can be determined by the force determiner 901 can whenreceived by the touch force modulator 903 can generate a full scale sinewave such as for example a 16 bit full scale sine wave at 300 Hz whichis then mixed to the uplink signal by the audio mixer 105.

The operation of determining a touch audio signal dependent on thepressure or force experienced by the touch input module 11 is shown inFIG. 11 by step 1003 although as shown in the embodiments described withrespect to FIGS. 10 and 11 the touch force modulator 903 is configuredto modulate the amplitude of the output signal based on the touch forceit would be understood that in some embodiments the frequency, or dutycycle of the output signal is modulated dependent on the touch force.

Furthermore it would be understood that any suitable relationshiplinear, non-linear, proportional, inversely proportional, monotonic orotherwise between the force/pressure and modulation can be implementedby the touch force modulator 903. In some embodiments a look up tablerather than a mathematical determination can be implemented to determinethe output with respect to the force/pressure and modulationrelationship.

With respect to FIG. 12 an example multichannel operation of thetouch-audio signal generator is shown according to some embodiments.Furthermore with respect to FIG. 13 the multichannel operation of themodulator is described.

In some embodiments the touch audio signal generator 101 comprises atouch position determiner 1101. The touch position determiner as shownin FIG. 12 determines the Y axis touch point displacement however itwould be understood that in some embodiments the position determiner candetermine the X axis touch point displacement or location of multiplepoints of contact as a combined X and Y axis position. The touchposition determiner 1101 can be configured to output the position to thetouch channel modulator 1103.

The operation of determining the touch location is shown in FIG. 13 bystep 1201.

In some embodiments the touch audio signal generator 101 comprises atouch channel modulator 1103. The touch channel modulator is configuredto output multichannel audio signals, for example a stereo or twochannel audio signal such that when the combined channel audio signalsare encoded, transmitted, received decoded and passed to be output bythe audio display at the receiver end the user can determine relativelywhere on the touch input module the pressure was applied or determinedto have been applied.

The touch channel modulator 1103 as shown in FIG. 12 is configured togenerate a first channel CH1 and a second channel CH2 audio signal andfurther to modulate the amplitude of the channel output in such a waythat the amplitude increases for one channel as the Y displacementincreases and the amplitude for the second channel decreases as the Ydisplacement increases. This for example is shown in FIG. 12 as thefirst channel audio signal CH1 is a lesser first amplitude A₁ 1111 whena first Y axis touch position displacement 1103 is determined and agreater second amplitude A₂ 1113 when a second Y axis touch positiondisplacement 1101 is determined whereas the second channel CH2 is agreater amplitude A₄ 1123 when the first Y axis touch positiondisplacement 1103 is determined and a lesser amplitude value A₃ 1121when a second Y axis touch position displacement 1101 is determine.

Although in such embodiments the amplitude is shown being modulateddependent on the position it would be understood that in someembodiments the frequency can be modulated. Furthermore although twochannels are described in these embodiments more than two channels canbe implemented in some embodiments for example where the audio displayhas more than two actuators. Furthermore it would be understood that therelationships can be any suitable differential relationships.

The operation of generating the channel pseudo-audio signal dependent onlocation is shown in FIG. 13 by step 1203.

Furthermore in some embodiments the touch input module can be configuredto generate a specified pseudo-audio signal dependent on a determinedtouch gesture or event. For example the touch input module 11 can insome embodiments be configured to determine a specific gesture, whichmay be single or multi-touch and generate a pseudo-audio signal to bepassed to a further apparatus to be processed and in some embodiments‘displayed’ or output on the further apparatus audio display. Forexample the touch input module 11 can in some embodiments be configureto determine a sweep, pinch zoom, circle or other suitable gesture andoutput a pseudo-audio signal dependent on the gesture and any suitablecharacteristics of the gesture. In some embodiments thus the touch inputmodule 11 can determine that a circling motion is being made on thetouch module and output an amplitude dependent on the radius of thecircle being ‘drawn’ and a frequency dependent on the speed at which thecircle is being drawn.

In some embodiments the apparatus can define gestures and further definewhat haptic signal or pseudo audio or audio signal the determination ofthe gesture can trigger. In other word the apparatus can be configuredto record gestures and associate audio or pseudo audio signals and/orfiles with the gesture.

In some embodiments the detected or determined gesture can be the lengthof contact of the touch on the touch input module, which can generate apseudo-audio signal which when output on the tactile user outputapparatus can generate a similar length vibration. In such embodimentsthe touch on the touch input module can therefore be a dot, or dashsignal input, such as a Morse coded signal which is output as a similarMorse coded signal on the audio display. In some embodiments theapparatus receiving the Morse coded signal is configured to decode thesignal and provide a visual representation of the Morse code taps in theform of plain text.

In the examples described above the touch audio signal generator hasgenerated a sinusoidal or substantially sinusoidal signal. It would beunderstood that in some embodiments any suitable waveform can be used asa base pseudo-audio waveform. For example in some embodiments there canbe defined a set of predefined signals which the touch audio signalgenerator can read from memory. These read waveforms can further bemodified dependent on the touch characteristics. For example thewaveform can be amplified by a gain factor dependent on the touchcharacteristic or be pitch shifted dependent on the touchcharacteristic.

In some embodiments the output of a force sensor can be used to changethe amplitude or pitch of the transmitted signal.

In some embodiments the apparatus can receive or download any suitablebase pseudo-audio waveform.

It would be understood that in some embodiments that the waveform can beany suitable mix of multiple waves.

Furthermore in some embodiments the waveform can be a suitable definedaudio signal that is changed based on the user actions. For examplepitch shifting can be employed to adjust the frequency for thepredefined audio signal. Furthermore in some embodiments the definedaudio signal can be amplified if the screen is touched from the top partand attenuated if the screen is touched from the bottom part.

In some embodiments a VoIP phone call (wideband audio preferred) isestablished. It would be understood that in some other embodiments anysuitable communication can be made between the tactile user inputapparatus and the tactile user output apparatus. In some embodiments thetactile user input apparatus can be configured to use a VoIPcommunication protocol wherein meta information or metadata associatedwith the audio signal is communicated with the audio signal.

In some embodiments the metadata or meta information comprisesinformation or indication on the coordinates of the touch (hover orcontact touch) on the touch input at the tactile user input apparatus.

Thus for example the user of a first apparatus presses the touch screenat a first point C defined by co-ordinates C_(x),C_(y). Furthermore theuser (which can in some embodiments be the same user) can be configuredin these embodiments to press/touch a further or second apparatus at asecond point C2 defined as C2 _(x),C2 _(y) then the first apparatus canbe configured to generate a tactile event (for example a tactile signalfrequency, e.g. 250 Hz, and fixed amplitude, e.g. 16-bit full scale sinewave, to be mixed to the uplink audio signal for the first apparatus.

The user of the further apparatus (which for example in some embodimentsis a tactile audio display apparatus) holding their hand on the furtherapparatus display can be configured to receive the tactile eventindicator/message/signal and the further apparatus can output thetactile signal which can be configured to be felt as the touch eventsignal haptic feedback.

In some embodiment the user of the first apparatus can move the point oftouch to a third point D (D_(x),D_(y)). In some embodiments unless theuser of the further apparatus moves the touch to a corresponding fourthpoint D2 (D2 _(x),D2 _(y)), then there is no additional generated event.

In some embodiments the tactile event can be passed more than one way,for example in some embodiments when it is determined that bothapparatus displays are pressed at the same time at the same orcorresponding coordinates, the touch event is generated and output toboth apparatus uplink signals. In some embodiments more than twoapparatus can communicate in such a manner where matching touchdeterminations can be configured to generate a suitable tactile event inthe audio display.

In some embodiments the apparatus can be configured to send thehaptic/tactile signal on the uplink without a corresponding furthermatching apparatus. For example the localized haptics the user of thefirst apparatus will be output on the uplink and can be felt by the userof the further apparatus no matter where the use of the further devicetouches the display.

In some embodiments the outputting of coordinates as metadata from thefirst apparatus to the user of the further apparatus can cause thefurther apparatus to generate on a visual display an image representingthe co-ordinates. For example in some embodiments the visual displayelement can be an image of a linger ‘touching’ the display at thecoordinates sent from the apparatus. In such embodiments the visualdisplay element, for example the image of the ‘finger’ can indicate tothe user of the further apparatus where to touch the further apparatusaudio display to receive or stimulate haptic feedback. It would beunderstood that in some embodiments any suitable image can be used torepresent the co-ordinates, for example a stored or downloaded image oricon representing the user of the first apparatus.

In some embodiments the feedback, such as the tactile feedback, can bepre-loaded or generated based on some metadata information.

In some embodiments the background image can also be determined orchanged by the user of the further apparatus or can be provided as partof the metadata. For example as a JPEG image sent as metadata from thefirst to further apparatus.

In some embodiments the metadata sent between apparatus could alsoinclude other information concerning the sending apparatus. For examplein some embodiments the metadata can comprise at least one of: thestatus of the vibra component and parameters associated to it in thesending apparatus; the status of any sensors (for example the proximitydetector, ambient light sensor, magnetometer, accelerometer) andparameters associated to the sensor in the sending apparatus, the statusof the RF receivers and RF transmitters and parameters associated to theradio frequency receiver and/or transmitter in the sending apparatus. Insome embodiments this information can be used as an input for generatinga suitable tactile event output, for example by defining or adjustingthe tactile feedback signal. In some embodiments the metadata can beconfigured to have a reference (for example an URL or some ID) to asuitable defined audio signal. In some embodiments this reference can beused within the apparatus to provide the tactile signal. In some otherembodiments the defined audio signal, which provides the tactile signal,is not stored in the apparatus, but can be found from or in the “cloud”.

Furthermore although the examples described herein describe the‘touching’ or pressing the display at certain points it would beunderstood the moving the finger or touch object on the display can alsobe configured to change the output. In other words the signal isadjusted ‘on the fly’ when the finger or touch object is moved.

In some embodiments a touch input may be replaced by or added to by anysuitable input. For example the input can comprise an accelerometerinput (the way the apparatus is rotated can be used as an input toadjust the signal), a magnetometer input (the direction the apparatus ispointing can be used as an input), a proximity detector input (theinformation about something being close to the surface of the apparatuscan be used as an input), an ambient light sensor input (the lightnessof the surrounding space can be used as an input), and a GPS signalinput (the location, speed or acceleration of the apparatus can be usedas an input). Furthermore the force sensor can in some embodiments beused to detect finger press on the screen.

The apparatus can in some embodiments therefore offer a user interfaceenabling the user can select from list of possible predefined audiosignals to be played to the uplink. The selection can be offered forexample in some embodiments as a group of buttons, but it would beunderstood that in some other embodiments other UI elements could beimplemented.

It would be understood that in some embodiments the examples describedherein can be implemented on apparatus which do not comprise a tactileaudio display. For example the examples described herein can beimplemented where the further apparatus (the receiving apparatus) is atactile audio display apparatus whether the first apparatus (the sendingapparatus) is a tactile audio display device or not. However it would beunderstood that where the receiving apparatus is not a tactile audiodisplay apparatus, then the tactile feedback received will generateaudible signals which could be annoying.

In some embodiments the sending apparatus can be configured to recognisewhether the receiving apparatus is a tactile audio display apparatus (ornot). For example in some embodiments where the communication betweenapparatus is a proprietary VoIP communication protocol this informationcan be sent as metadata. Furthermore in some embodiments, for example ina circuit switched communication (and furthermore applicable to VoIPcommunications) information about the tactile audio display apparatuscould be inaudibly “watermarked” into the speech signal (or other audiosignal) that can then be recognized by the receiving apparatus. Thiswatermarking and its recognition would not cause any problems withnon-tactile audio display apparatus. In some embodiments the secondapparatus can be configured to ‘filter out’ the tactile feedbackcomponent or be configured to route the tactile feedback component to avibra to provide some feedback.

In some such embodiments where the sending apparatus determines thereceiving apparatus is a tactile audio display apparatus, then thesending apparatus can decide whether to send the tactile feedback to thefurther apparatus.

In some embodiments the receiving apparatus can be configured to switchoff or on the tactile or haptic event generation such that the receivedtactile signal is not used to generate motion in the tactile audiodisplay. For example it could be annoying when the user receives tactilefeedback during a call especially when using it in hand-portable mode.

Thus for example in some embodiments the determination of implementingor generating the haptic/tactile output can be automatically determined,semi-automatically determined or manually configured.

In some embodiments the further apparatus can comprise a tactile outputdeterminer configured to stop or halt the generation of haptic signalswhen audio is routed to the earpiece transducer or the tactile audiodisplay is configured to operate in an earpiece mode. Furthermore thetactile output determiner can be configured to stop or halt thegeneration of haptic signals when the proximity detector and/or ambientlight sensor and/or camera and/or touch sensor determines an object (forexample an ear or a cheek) near the display.

The tactile output determiner can be configured in some embodiments toignore or pass the metadata dependent on whether the tactile output isto be generated. Furthermore in some embodiments the tactile outputdeterminer can be configured to control passing or blocking of thehaptic signal where the haptic signal is received as a separate audiopath than the phone call or received audio signal.

In some embodiments where the haptic feedback signal is received as partof the combined audio signal (for example an audio signal from phonecall with the pseudo audio signal representing the tactile event) thensignal processing can be employed to separate/filter the pseudo-audiosignal. For example in some embodiments the tactile output determinercan be configured to filter out the frequencies where tactile feedbackis strongest. In some embodiments the tactile output determiner can beconfigured to employ noise cancellation or comparable to tune thepseudo-audio signal representing the haptic feedback away.

It shall be appreciated that the term user equipment is intended tocover any suitable type of wireless user equipment, such as mobiletelephones, portable data processing devices or portable web browsers.Furthermore, it will be understood that the term acoustic sound channelsis intended to cover sound outlets, channels and cavities, and that suchsound channels may be formed integrally with the transducer, or as partof the mechanical integration of the transducer with the device.

In general, the design of various embodiments of the invention may beimplemented in hardware or special purpose circuits, software, logic orany combination thereof. For example, some aspects may be implemented inhardware, while other aspects may be implemented in firmware or softwarewhich may be executed by a controller, microprocessor or other computingdevice, although the invention is not limited thereto. While variousaspects of the invention may be illustrated and described as blockdiagrams, flow charts, or using some other pictorial representation, itis well understood that these blocks, apparatus, systems, techniques ormethods described herein may be implemented in, as non-limitingexamples, hardware, software, firmware, special purpose circuits orlogic, general purpose hardware or controller or other computingdevices, or some combination thereof.

The design of embodiments of this invention may be implemented bycomputer software executable by a data processor of the mobile device,such as in the processor entity, or by hardware, or by a combination ofsoftware and hardware. Further in this regard it should be noted thatany blocks of the logic flow as in the Figures may represent programsteps, or interconnected logic circuits, blocks and functions, or acombination of program steps and logic circuits, blocks and functions.The software may be stored on such physical media as memory chips, ormemory blocks implemented within the processor, magnetic media such ashard disk or floppy disks, and optical media such as for example DVD andthe data variants thereof, CD.

The memory used in the design of embodiments of the application may beof any type suitable to the local technical environment and may beimplemented using any suitable data storage technology, such assemiconductor-based memory devices, magnetic memory devices and systems,optical memory devices and systems, fixed memory and removable memory.The data processors may be of any type suitable to the local technicalenvironment, and may include one or more of general purpose computers,special purpose computers, microprocessors, digital signal processors(DSPs), application specific integrated circuits (ASIC), gate levelcircuits and processors based on multi-core processor architecture, asnon-limiting examples.

Embodiments of the inventions may be designed by various components suchas integrated circuit modules.

As used in this application, the term ‘circuitry’ refers to all of thefollowing:

-   -   (a) hardware-only circuit implementations (such as        implementations in only analog and/or digital circuitry) and    -   (b) to combinations of circuits and software (and/or firmware),        such as: (i) to a combination of processor(s) or (ii) to        portions of processor(s)/software (including digital signal        processor(s)), software, and memory(ies) that work together to        cause an apparatus, such as a mobile phone or server, to perform        various functions and    -   (c) to circuits, such as a microprocessor(s) or a portion of a        microprocessor(s), that require software or firmware for        operation, even if the software or firmware is not physically        present.

This definition of ‘circuitry’ applies to all uses of this term in thisapplication, including any claims. As a further example, as used in thisapplication, the term ‘circuitry’ would also cover an implementation ofmerely a processor (or multiple processors) or portion of a processorand its (or their) accompanying software and/or firmware. The term‘circuitry’ would also cover, for example and if applicable to theparticular claim element, a baseband integrated circuit or applicationsprocessor integrated circuit for a mobile phone or similar integratedcircuit in server, a cellular network device, or other network device.

The foregoing description has provided by way of exemplary andnon-limiting examples a full and informative description of theexemplary embodiment of this invention. However, various modificationsand adaptations may become apparent to those skilled in the relevantarts in view of the foregoing description, when read in conjunction withthe accompanying drawings and the appended claims.

However, all such and similar modifications of the teachings of thisinvention will still fall within the scope of this invention as definedin the appended claims.

The invention claimed is:
 1. An apparatus comprising: at least oneprocessor; and at least one memory including computer code for one ormore programs, the at least one memory and the computer code configuredto with the at least one processor cause the apparatus to at least:determine a touch input characteristic at a near-end device; generate apseudo-audio signal; mix the pseudo-audio signal at the near-end deviceduring an active communication; and transmit the pseudo-audio signalfrom the near-end device to one or more separate apparatus wherein theone or more separate apparatus at least partially forms a communicationssystem during the active communication with the near-end device, whereinthe pseudo-audio signal by the near-end device is configured to generatea tactile output.
 2. The apparatus of claim 1 further comprising anaudio signal mixer, wherein the audio signal mixer is configured toreceive an audio signal from an audio signal source and the pseudo-audiosignal from a touch audio signal generator and mix these signals to forma combined audio signal.
 3. The apparatus of claim 2 wherein the atleast one memory including computer code for one or more programs, theat least one memory and the computer code are configured to with the atleast one processor to cause the apparatus to pass the combined audiosignal to an encoder.
 4. The apparatus of claim 2 wherein the audiosignal mixer is configured to mix the pseudo-audio signal from the touchaudio signal generator where there is no active audio input.
 5. Theapparatus of claim 2 wherein the audio signal mixer is configured toreceive more than one audio signal and/or more than one pseudo-audiosignal.
 6. The apparatus of claim 2 wherein the audio signal mixer isconfigured to receive more than one pseudo-audio signal from more thanone tactile source.
 7. The apparatus of claim 1 further comprising afrequency modulator configured to modulate a pseudo-audio signal outputdependent on touch pressure or force, number of touch points ordeterminable input parameters or characteristics.
 8. The apparatus asclaimed in claim 1, wherein the determined input characteristic causesthe apparatus to: determine a touch input; determine of the touch inputcharacteristic; and generate a signal dependent on the determined touchinput characteristic, wherein the signal is configured to generate thetactile output.
 9. The apparatus as claimed in claim 1, wherein thedetermined touch input characteristic causes the apparatus to: determinea force/pressure of the touch input; determine a displacement of thetouch input in a first direction relative to an edge of the touch inputapparatus; determine a displacement of the touch input in a seconddirection substantially orthogonal to the first direction; determine aspeed of the touch input; determine a co-ordinate of the touch input;determine a number of points of contact of the touch input; anddetermine a gesture from the touch input.
 10. The apparatus as claimedin claim 1, wherein the determined input characteristic causes theapparatus to at least one of: determining a status of a vibra component;determining a vibra component parameter; determining a proximitydetector parameter; determining an ambient light sensor parameter;determining a magnetometer parameter; determining an accelerometerparameter determining a GPS parameter; determining a status of thereceiver; determining a status of a transmitter; determining a radiofrequency receiver parameter; and determining a radio frequencytransmitter parameter.
 11. An apparatus comprising: at least oneprocessor; and at least one memory including computer code for one ormore programs, the at least one memory and the computer code configuredto with the at least one processor cause the apparatus to at least:receiving a combined signal comprising a tactile signal and an audiosignal, wherein the combined signal is provided during an activecommunication, wherein the combined signal is dependent on an inputcharacteristic from a separate apparatus; and generating a tactileoutput dependent on the combined signal.
 12. The apparatus as claimed inclaim 11, wherein the receiving the combined signal comprises: receivingthe combined signal from memory; receiving the combined signal from afurther apparatus.
 13. The apparatus as claimed in claim 11 wherein adecoder of the apparatus is configured to generate a signal dependent onthe received combined signal from the separate apparatus.
 14. Theapparatus as claimed in claim 13 wherein the decoder is configured tooutput a combined signal to an audio display module.
 15. The apparatusas claimed in claim 14 wherein the audio display module is configured totransduce the signal component to generate the tactile output.
 16. Theapparatus as claimed in claim 11 wherein an audio driver of theapparatus is configured to generate the tactile output.
 17. Theapparatus as claimed in claim 11, wherein the apparatus comprises anaudio driver configured to control the audio display module to generatean audio output.
 18. The apparatus as claimed in claim 11, wherein thecombined signal comprises at least one of: an indicator for a vibrasignal; a vibra signal frequency; a vibra signal amplitude; a vibrasignal waveform definition; vibra signal waveform definition indicator;and at least one sine wave signal.